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We introduce magnetization to the Multi-layer Random Energy Model which has a hierarchical 
structure, and perform Monte Carlo simulation to observe the behavior of ac-susceptibility. We 
find that this model is able to reproduce three prominent features of spin glasses, i.e., memory 
effect, rejuvenation and chaos effect, which were found recently by various experiments on aging 
phenomena with temperature variations. 
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§1. Introduction 

The free energy of complex systems such as spin glasses, polymers and proteins, is considered to 
have a very complex structure with numerous local minima. Due to this complexity, it costs very 
long time for equilibration of these systems and various non-equilibrium relaxation phenomena are 
observed. From experiments focused on these non-equilibrium relaxations, the aging phenomena, 
which are dynamical behaviors largely depending on the history of system, were found and have 
been studied vigorously from both theoretical and experimental aspects, in particular, in spin glass 
systems .0>§§i>ii> 

Recently the following interesting experiment has been reported in spin glasses.@'!'& In this 
experiment, the relaxation of the out-of-phase ac-susceptibility x" is observed in the following three 
stage. In the first stage, the sample is quenched from above T c down to a temperature T below T c 
and is kept at this temperature during t\. Then the sample is perturbed by changing temperature 
from T to T ± AT during t% in the following second stage and the temperature is returned to T 
(the third stage). The effect of the perturbation is examined by comparing the perturbed data 
and unperturbed fa = 0) data in the third stage. In the case —AT, both data coincide except 
at the very beginning. This means that the relaxation at T — AT never affects the relaxation at 
T and the system remembers the relaxation during t\ after perturbation. We call this as memory 
effect hereafter. In the case +AT, on the other hand, we can see that x" becomes larger than the 
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unperturbed correspondence and the rejuvenation occurred during ti- These 'memory effect' and 
'rejuvenation' are observed in other experiments.^ 

From the theoretical point of view, the aging phenomena have been studied along two different 
pictures. One is the droplet picture,0'0) where the behavior in the spin glass phase is governed 
by the low laying and large length scale excitation. The other is the so-called hierarchical pic- 
ture. i3 from which we will try to understand the phenomena in this manuscript. 

According to the Parisi mean-field solution of the SK model, the free energy in the spin-glass 
phase has a very complex structure with numerous local minima. These valleys are considered to 
be divided into smaller valleys as the system is cooled and micro phase transitions occur with this 
continuous multifur cation. From this hierarchical structure, the memory effect and rejuvenation 
mentioned above can be explained as follows.^ When the temperature is cooled from temperature 
above T c down to T, the system falls into one of the numerous local minima. Then, the system 
is equilibrated in some region of the phase space including several valleys, 1Z, during t\. Now we 
consider to change the temperature from T to T ± AT. In the case —AT, each valley at T is 
divided into smaller valleys. If AT is large enough and the time ti is not so long, the equilibration 
proceeds only in the smaller valleys and we can ignore the possibility that the system overcomes 
the barrier which separates the bigger valleys at T. Therefore, when the temperature is raised back 
to T and smaller valleys merge, we find that the system are unchanged during t% and the memory 
effect appears. In the case +AT, on the other hand, several valleys in 1Z merge into one valley and 
the system forges the equilibration at T. Thus the system is rejuvenated. 

This explanation is, however, quite qualitative and there exists no theoretical model which repro- 
duces these features along this hierarchical picture. In this manuscript, we study the Multi-layer 
Random Energy Model (MREM)0EP which has a hierarchical structure causing a continuous 
phase transition. We introduce magnetization to this model so that we can carry out the simula- 
tion to observe the ac-susceptibility, and find that the memory effect and rejuvenation are indeed 
reproducible. Furthermore, we analyze the mechanism of these phenomena and show that the 
above-mentioned scenario realizes these features, at least, in this model. 

Another feature we are interested in is the chaos effect found in experiments on the ac- 
susceptibility .111- 1 The fact found is that the equilibration at the temperature T does not affect 
the relaxation at a lower temperature T — AT. This can be interpreted as follows. If the structure 
of the free energy at T — AT is quite different from that at T, the equilibration at T never helps 
the equilibration at T — AT. But this reorganization of structure makes us unable to explain the 
memory effect, which is also observed in the same experiment. There seem to exist few theoretical 
explanations for these apparently conflicting features, i.e., memory and chaos effects. We find that 
these conflicting features hold simultaneously in the MREM in a situation slightly different from 
the experiment in ref. [l^. We also analyze the mechanism of these phenomena in this model. 
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§2. The Multi-layer Random Energy Model 

Let us first explain the Simple-layer Random Energy Model (SREM) illustrated in Fig. 1. The 
bottom points represent the accessible states of this system. We hereafter consider the case that 
the number of states is very large. The length of each branch represents the barrier energy E, over 
which the system goes from one state to another. This energy is an independent random variable 
distributed as 

d P 

p(E)dE = —eM-E/T c ], (2.1) 

where T c is the transition temperature. 

From the Arrhenius law, the relaxation time r(a), i.e., the average time for the system to escape 
from the state a, is related to E{a) as 

t(q) = r exp[£ , (a)/T], 



where tq is a microscopic time scale. From eq. (2.1), the distribution of r can be written as 



p(r)dr = ^ T dr (r>r ), (2.2) 



where x = T/T c . From eq. fl2,2| ), it is easily shown that the averaged relaxation time (t) is 
tqx/(x — 1) for x > 1 and infinite for x < 1. This means that the transition from the ergodic phase 
to the non-ergodic phase occurs at T c . 

Now we construct the Multi-layer Random Energy Model (MREM). As shown in Fig. 2, this model 
is constituted by piling up the SREM L times hierarchically. The energy of the n-th layer counted 
from the bottom, E n , is given according to the distribution p n (E n ) = exp[— E n /T c (n)]/T c (n) and 
each layer has a different transition temperature chosen so as to satisfy T c (l) < T c (2) < • • • < T C {L). 
Therefore, in this model the transition occurs continuously from the uppermost (the L-th) layer to 
the lowest one. 

2.1 The dynamics 

In this simulation, we use the following Markoff process for dynamics. First the system is ther- 
mally activated from a to ai, where a n is the n-th ancestor of a (see Fig. 2). The probability that 
this event occurs at time t in unit time is defined as 

u(a;t) = r^" 1 exp[-Ei (q)/T]. (2.3) 

The t dependence comes implicitly from time variation of temperature and magnetic field. We 
will introduce the effect of magnetic field in the following subsection. Since the time evolution is 
Markoffian, we can easily evaluate the probability q(a;to,t)dt for the event to occur during t and 
t + dt with knowing that the system is in the state a at time to as 

q(a; to, t)dt = u>(a; t)dt exp[— / dt'oj(a; t')]. (2-4) 

Jt 
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We generate an event time t according to q(a; to,t) to perform event-driven Monte Carlo simulation. 

Once the event occurs and the system is activated to a±, it may be activated further to 02, «3 or 
higher branching point. We accept the excitation to 02 with the probability exp[— Ei{ol)/T\. If it 
is accepted, the next trial to «3 follows. By repeating these procedures, we obtain the probability 
H{n) that the system is activated from a\ up to a n as 

n 

H(n) = (1 - exp[-E n+1 (a)/T]) ]J exp[-E k (a)/T], (2.5) 

k=2 

where El + i(o) = 00. 

Finally, we adopt the simplest falling process from a n . The system falls to one of all states under 
a n with equal probability. In the limit that the number of branches in each layer is infinite, we 
can neglect the possibility that the system has visited one state more than twice in our finite time 
simulation. Therefore, in this simulation, we create a new state (5 after each activation. Note that 
if the system is activated to n-th layer, we set E k (P) = E k (a) for k > n + 1, although for k < n, 
Ek is updated according to the density of state Pk(E). 

We note that the whole process drives the system to the equilibrium distribution proportional to 
exp[En^nA1. 

2.2 Assignment of magnetization 

In order to observe the magnetic response, we introduce magnetization to the MREM. It is natural 
to suppose that the nearer two states are located in the phase space the stronger the correlation of 
the two magnetizations is, and that the distance in the MREM can be measured in terms of barrier 
height. In fact the barrier height is related with the overlap in the SK model© To incorporate 
this aspect, we assign the value of magnetization to state a, M a , as 

M a = M (a) + Mi(ax) + ■■■ + 7W L _i(a L _i), (2.6) 

where Mkio-k) is a contribution from the branch point a k given as a independent random variable 
with zero mean. The correlation between M a and Ma with the lowest common branch point a k 
comes from the common contributions of A4 n , (n = k, k+1, • • •) to these magnetization. It decreases 
monotonically as k increases and the barrier becomes higher. 
In this simulation, we choose a uniform distribution for A4 of the n-th layer as 

f ^ (\M\ < -L), 

D n {M) = { 2 ~ ^' (2.7) 

1 (|M|>^). 

The range of distribution is determined so that the variance of M a is independent of L. 

The Zeeman energy due to applying magnetic field H(t) is attributed to the lowest layer and 
Ei{a) in eq. (U) is replaced with E 1 {a) + H(t)M a . 

To summarize, we introduce the concrete procedure of our simulation. 
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(i) Choose the initial state a. Because we consider the situation that the system is quenched from 
infinitely high temperature, we determine E k (a) (k = 1, . . . , L) according to p k (E). We also 
determine M k {a) from D k (Ai). 



(iv) Give the energy and magnetization of new state (3. When the system is activated to a n , we 
set E k (j3) = E k (a) and M{(3) = M(a) for k > n + 1 and give E k ((3) and M(f3) from p k (E) 
and D(M) for k <n. 

(v) Set the time ahead by t stay and return to (ii). 

We show an example of simulation for L = 2 with a weak ac-field. We plot A4 k (t) (k = 1, 2) in 
one trial in Fig. 3 (a), and averaged magnetization over 2 x 10 7 trials in Fig. 3(b). We can see that 
in one trial, A4 k keeps a constant during the system stays at a state and changes discontinuously 
when activation occurs. We can see that the activation to the 1-st layer and the one to the 2-nd 
layer occurs at ti and t\ respectively. From this figure, we can not find the effect of ac-field. But 
this effect emerges by taking average over numerous trials, as shown in Fig. 3(b). We estimate 
x"(t) directly from data of this kind. 

§3. The Result of Simulations 

In the following we show the result of simulations performed on the MREM with L = 2, T c (l) = 
0.6 and T c (2) = 1.0. The number of samples used for random average is typically 10 7 . The 
amplitude and the period of applying ac-field are fixed to 0.1 and lOOro, respectively. Hereafter 
this period is used as the unit of time. 

3.1 The case -AT 

In the first stage the system evolves in temperature T = 0.85 for time interval t\. Temperature 
is then reduced to T — AT = 0.5 for t-i (the second stage), and brought back to T in the following 
third stage. Note that these temperatures are set so as to satisfy 



In Fig. 4, we plot imaginary part of ac-susceptibility, for two different intervals of the first stage, 
t\ = 20 and 100. In inset we plot t% and part of data. We can see that the memory effect takes 
place. We also find in the data for t\ = 100 the slight jump at the beginning of the second stage 



In Fig. 5, we plot x'o and Xi evaluated from Mo and M\, respectively (x" = Xo + x'i)- We can 
see that x'o remains almost constant in the first and third stage because T > T c (l) so that the first 
layer quickly relaxes to the equilibrium. The long-time dependence of relaxation is dominated by 
the second layer there. In contrast the first layer is dominant in the second stage because T — AT 




Determine the time t s tay that the system stay at a from eq. (2.4). 



Determine how far the system is activated by eq. ( |2.5| ). 



T — AT < T c (l) < T < T c (2). 



as seen in experiment 



.1) 
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is too low for the second layer to be activated and x'{ is much smaller than x'o- Prom these results, 
we notice that the dominant layer changes as temperature varies. 

we can also see that the slight jump of x" mentioned above is brought from x'o- This sudden 
increase of x'o is due to the quenching of the first layer across its transition temperature T c (l). 

In Fig. 6, x's m the second stage is magnified for t\ = 20 and t\ = 100. There are few differences 
on both x'o an d x'{- This means that the length of the first stage, t\, does not affect the relaxation 
in the second stage. In this sense, we may say that the system has the chaos effect. On the other 
hand, t\ reflects on relaxation in the third stage and the memory effect appears. Thus the MREM 
has these two apparently conflicting features simultaneously. 

In order to investigate which states contribute to x" m more detail, we examine the energy 
distribution P n (E n ,t) which is defined as the probability density that the system is found at time 
t in one of the states whose energy of the n-th layer is E n . By the definition, we have P n (E n ,t = 
0) = p n (E n ) since the initial state is chosen randomly. 

In Fig. 7, we show the time dependence of P n (E n ,t) in the first stage. We can see that the 
distribution consists of two exponential functions which are connected to each other at some point, 
E* . The value of E* roughly represents the energy level up to which the system can be activated 
during time interval t, and is estimated as 

E* Tlog[t/r ]. (3.1) 

For E n < E* the distribution is aged or equilibrated, so that the exponent a\(n) is given as 

/ N 1 1 I N 

ctun) = — — — ; , , (3.2) 
v ; T r c (n)' v ' 

while the other part E n > E* leaves untouched and the exponent at2(n) is equal to that of p n (E), 

i.e., 

«2(n) = -7^t^- ( 3 - 3 ) 
T c (n) 

For the first layer we have ai(l) < since T > T c (l), and the distribution quickly converges to 
the equilibrium one (Fig. 7, left). Note that the discrepancy for E\ > E* is negligible in magnitude. 
For the second layer where a\{2) > 0, on the other hand, P2(E2,t) has a peak at E* moving right 
with time (Fig. 7, right). This is why x'[ continues to change with time while x'o remains almost 
constant in the first stage. 

Experiments on the Zero-Field-Cooled (ZFC) magnetization in spin glassesi'!) showed that the 
distribution of the relaxation time r, which has a peak at r max , depends on the waiting time t w 
and T max appears near i w , which just corresponds to the shift of peak shown in the right of Fig. 7. 

In Fig. 8, we show the time dependence of P n (E n ,t) in the second stage. We can see that a peak 
appears and moves to right for the first layer (Fig. 8, left). As for P2(E2,t), the global aspects 
such as the position of peak formed in the first stage do not change although the distribution of 
the lower energy decreases gradually. This brings the memory effect to the system. 
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To see how t\ affects the energy distribution, we plot in Fig. 9 P n (E n , t) for t\ = 20 and t% = 10 2 
with the same t in the second stage. As for the first layer, the both distributions are almost the 
same since the layer is well equilibrated in the first stage. In the second stage, this layer is dominant 
and the behaviors of x" are almost the same in the two cases. On the other hand, the difference of 
the peak position quenched since the end of first stage, makes the shapes of P2(E2,t) very different 
from each other, and this causes, in turn, the difference in the behavior of x" i n the third stage. 

3.2 The case +AT 

In Fig. 10, the x" f° r the case +AT is shown. The heating is done twice in this case. We set the 
temperatures as T = 0.5, T + AT = 0.85, which satisfy the relation T < T c (l) < T + AT < T c (2). 
We can see from this figure that the rejuvenation occurs. 

We show the behavior of x'q and Xi m Fig. 11. In this case we can see that the Xi dominates the 
slow relaxation in the second and fourth stages as expected. The rejuvenation occurs only in x'q 
but not in Xi- 

In Fig. 12, we compare the behavior of x" m the first, third and fifth stages. Although the value 
in the first stage is slightly larger than that in the third, those in the third and fifth stages are 
collapsed to a single curve, which means the perfect re-initialization. 

We again examine P n (E n ,t) in this case. In Fig. 13, the time evolution of P\(Ei,t) in the second 
stage is shown. The peak created in the first stage is rapidly destroyed and the information on 
the relaxation in the first stage is completely forgotten. In fact we find that the peak starts to 
disappear at t ~ t\ + 1 , i.e., just after the second stage begins. 

§4. Conclusions and Discussions 

We have shown that the present MREM can reproduce the prominent behaviors found in spin 
glasses such as the memory effect and the rejuvenation although the number of layers is only two. 
This indicates that the alternation of the activated layer is important to explain these features in 
this model. We expect that the phenomena can be observed at any T < T c in the MREM with 
large L. 

Now let us discuss what happens when L > 1 along the scenario proposed by Bouchaud and 
Dean.© For a given temperature T < T C (L) = T c , there exists the n-th layer such that T c (n — 1) < 
T < T c (n). The essential point is the fact that layers below n are quickly equilibrated and they 
forget what happened before the temperature is set, while those above n are almost quenched and 
they behave as if the time evolution stops. In this sense the n-th layer is the activated one and 
dominates the relaxation of the system. This mechanism certainly explains the memory effect and 
the rejuvenation as shown in the present work. In this context, the chaos effect means that the 
layer which is to be activated when temperature decreases is not capable to remember the previous 
situation and it relaxes from tabulae rasae. Therefore it is not necessary to introduce a chaotic 
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reorganization of hierarchy for description of the phenomena. 

Finally, let us compare the droplet model with the MREM and try to fuse these models. In the 
droplet model, system ages by growth of droplets. On the other hand, aging means the shift of 
the peak of P(E) in the frozen layers (the layers which satisfy T < T c (n)) in the MREM. In both 
model, aging means to seek more stable states with time and these processes make the system 
stiffer and the response to an external field weaker. This is the reason why the ac-susceptibility 
decreases monotonously with age. Moreover, as discussed Jonason et al, it may be possible to 
map the MREM into the droplet model as following. We now consider what will happen when we 
cool real spin glass systems across the T c (which corresponds to T C (L) in the MREM). Above T c , 
all the spins flip rather free. When the system is cooled just below T c , we can consider that larger 
droplets are blocked at first and the spins in these droplets begin to flip collectively. In this stage, 
the spins in smaller droplet are still free relatively. In the MREM, the larger droplets correspond 
to the upper frozen layers and the smaller droplets correspond to the lower unfrozen layers. As the 
temperature is lowered, smaller droplets begin to be blocked and flip collectively. But the larger 
droplets which blocked earlier are almost frozen and they can hardly flip at this temperature. We 
expect that these successive processes bring the memory effect, rejuvenation and chaos effect as 
discussed in this manuscript. Furthermore, the idea of droplets within droplets® will naturally 
lead to the hierarchical organization of droplets. It is challenging to find these structures, if really 
exist, in the real spin space of spin glasses. 
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FIGURE CAPTIONS 

Fig. 1 Structure of the Simple-layer Random Energy Model. 

Fig. 2 Structure of the Multi-layer Random Energy Model with L = 2. 

Fig. 3 (a) M.\(t) (dashed line) and M.2{t) (solid line) observed in one trial and (b) averaged Mk(t) 
over 2 x 10 7 trials. 

Fig. 4 x" for the case —AT with t\ = 20 (dashed line) and t\ = 100 (solid line). In the inset, the 
data in the first and third stage are plotted. 

Fig. 5 x'o (solid line) and x'{ (dashed line) for the case —AT. 

Fig. 6 x" m the second stage, x'o with ti = 20, x'o with t\ = 100, x'l with t\ = 20 and x'{ with 
ti = 100 (from top to bottom). 

Fig. 7 P n (E n , t) in the first stage at t = 1, 10 5 , 10, ... , 10 2 (from left to right). 

Fig. 8 P n (E n , t) in the second stage at t = 0, 10~ L5 , 10 _1 , . . . , 10 2 (from left to right). 

Fig. 9 P n (E n , t) for h = 20 (left) and h = 100 (right) in the second stage at t = h + 10 1 - 5 . 

Fig. 10 x" fo r the cas e +AT. In the inset, the tree parts of perturbed data and unperturbed data 
are shown. 

Fig. 11 x'o (upper) and x'{ (lower) for the case +AT. 
Fig. 12 x" hi the first, third and fifth stages. 

Fig. 13 P\(Ei,t) in the second stage for the case +AT at time t = t\ + At with At = 

io- 15 ,io- 1 ,...,io 2 . 
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